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ABSTRACT 



Matches between questions in the Kentucky Instructional 
Results Information System for 1995-96 (KIRIS96) , the Comprehensive Tests of 
Basic Skills, Fourth Edition (CTBS4) , and the California Achievement Tests, 
Fifth Edition (CAT5) and the Kentucky Academic Expectations as they are 
defined in the Kentucky curriculum framework were studied. Each assessment 
question was read by two or three researchers familiar with the Academic 
Expectations. They found the KIRIS96 questions to be well written, and that 
they covered the Academic Expectations for the most part. Parts of the 
curriculum that were not so well sampled by the KIRIS96 questions were 
identified. The CTBS4 and the CAT 5 did not cover the Kentucky curriculum 
framework so well . The types of questions asked by those tests required less 
integration of complex thinking processes than the KIRIS96 questions. 

However, researchers noted that the CTBS4 and the CAT5 did a better job than 
the KIRIS96 in separately assessing student’s learning of certain traditional 
basic skills in spelling, mathematics computation, recognition of mathematics 
concepts, language mechanics, and use of specific language expressions. In 
general, standardized assessments have the advantage in providing measures of 
individual students' strengths and weaknesses in several traditional areas, 
and they have the advantage of being referenced to a national sample of 
students. (Contains three tables.) (SLD) 
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• As was discussed previously, our interpreta- 
tion of the Academic Expectations under 
Goal 5 may not be correct. 

• Sometimes we found that either the frame- 
work definitions were not clear or a 
KIRIS96 open-response question did not ap- 
pear to be crafted with the Academic Ex- 
pectation specifically in mind. (None of the 
documentation of the KIRIS96 question de- 
velopment process clearly indicated the path 
that was followed in deriving the questions 
from and assuring that they matched the 
Academic Expectations.) Thus, we often 
had to make assumptions about the main in- 
tent of the questions in relation to the Aca- 
demic Expectations. To the extent that our 
assumptions are in error, to that extent are 
the questions misclassified. 
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Table 1. Percentage of fourth grade assessment questions classified into each Academic Expectation category 
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Table 2. Percentage of eighth grade assessment questions classified into each Academic Expectation category 
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Table 3. Percentage of eleventh grade assessment questions classified into each Academic Expectation category 
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